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ABSTRACT 

In the paper the method for estimation of throughput met- 
rics hke available bandwidth and end-t-end capacity is sup- 
posed. This method is based on measurement of network 
delay Di for packets of different sizes Wi . The simple expres- 
sion for available bandwidth Bav = {W2 — Wi)/{D2 — D\) is 
substantiated. The number of experiments on matching of 
the results received new and traditional methods is spent. 
The received results testify to possibility of application of 
new model. 

Categories and Subject Descriptors 

C.2.3 [Computer-communication networks]: Network 
Operations — network monitonng; C.4 [Performance of sys- 
tems]: Measurement techniques 

Keywords 

new model for available bandwidth, end-to-end capacity, de- 
lay for packets of different sizes, RIPE Test Box 

1. INTRODUCTION 

Measurement of throughput metrics like available bandwidth 
and capacity gives a great chance to predict the end-to-end 
performance of applications, for dynamic path selection and 
traffic engineering, and select among numbers of differenti- 
ated classes of service. The throughput metric is an impor- 
tant metric for several applications, such as grid, video and 
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voice streaming, overlay routing, p2p file transfers, server 
selection, and interdomain path monitoring. 

Various real-time applications in Internet, first of all, trans- 
mission audio and video information become more and more 
popular, however for their qualitative transmission high- 
speed networks are required. The major factors defining 
quality of the service are: quality of the equipment (the 
codec and a video server) and an available bandwidth of the 
channel. Providers and their customers should provide a 
demanded available bandwidth for voice and video applica- 
tions to guarantee presence of demanded services in a global 
network. 

In this paper we define a network path as the sequence of 
links that forward packets from the path sender to the re- 
ceiver. There are various definitions for the throughput met- 
rics, but we will adhere to the approaches accepted in a series 
of papers by Dovrolis et al [5] |10[ [Ts] . 

Two bandwidth metrics that are commonly associated with 
a path are the capacity C and the available bandwidth Bav ■ 
The capacity C is the maximum IP-layer throughput that 
the path can provide to a flow, when there is no compet- 
ing traffic load (cross traffic). The available bandwidth Bav, 
on the other hand, is the maximum IP-layer throughput 
that the path can provide to a flow, given the path's cur- 
rent cross traffic load. The link with the minimum trans- 
mission rate determines the capacity of the path, while the 
link with the minimum unused capacity limits the available 
bandwidth. Measuring available bandwidth is not only for 
knowing the network status, but also to provide information 
to network applications on how to control their outgoing 
traffic and fairly share the network bandwidth. 

Another related throughput metric is the Bulk- Transfer- 
Capacity (BTC). The BTC of a path in a certain time period 
is the throughput of a bulk TCP transfer, when the transfer 
is only limited by the network resources and not by limita- 
tions at the end-systems. The intuitive definition of BTC 



is the expected long-term average data rate (bits per sec- 
ond) of a single ideal TCP implementation over the path in 
question. 

In order to measure different capacity metrics, the installa- 
tion of special utilities [l2] is required at both ends of path. 
This is uncomfortable process especially for usual Internet 
users who try to install modern network applications like 
videoconference service. 

For today also there are the various systems, allowing defin- 
ing an available bandwidth, but they have the disadvantages, 
therefore search of new solutions is claimed. Among them, 
such as iperf, netperf, pathrate, pathload and abget, and also 
a number of little-known programs ncs, netest, pipechar. We 
will consider the cores from the above described products. 
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Figure 1: Packet Size vs Delay 



Each of the products set forth above has disadvantages. 
Utilities Iperj, netperf, pathrate have one feature which is 
their essential disadvantage. To estimate capacity of a net- 
work it is required to instal client and server parts of the 
program. The utility ahget demands HTTP a server on the 
remote server and the privilege of the superuser, and as to 
programs ncs, netest, pipechar so they are not adapted for 
operation with network screens that in modern conditions 
does their a little used. 

At the same time these programs use algorithms of an es- 
timation of available bandwidth, grounded on transmission 
the considerable quantity of packages on a data link that 
reduces capacity of a network suffices and demands consid- 
erable time. 

In order to construct a perfect picture of a global network 
(monitoring and bottlenecks troubleshooting) and develop 
the standards describing new appendices, the modern mea- 
suring infrastructure should be installed. In Russia different 
measurement projects are realized in the area of networking, 
for example, PingER 
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in Institute of Theoretical and Ex- 
perimental Physics (ITEP), but full access to the collected 
data is limited for researchers. Unfortunately, current mea- 
suring area do not reflect structure of the Russian segment 
of a global network. 

At present time powerful measurement system like RIPE 
Test Box is expanded [t] . Unfortunately, this system doesn't 
measure the available bandwidth, but it collects the numer- 
ical values characterized the network heals like delay, jitter, 
routing path, etc. This data allows us to investigate the 
basic interdependencies of available bandwidth from basic 
network parameters. Our aim is to estimate the available 
bandwidth from the delay value, received from one point of 
path. 

In our work we try to present the uniform model, allow- 
ing measuring all known throughput metrics. Our method 
is based on testing of a network by packages of the differ- 
ent size. Earlier such technique called Variable Packet Size 
(VPS) was applied in work [6]. The VPS technique can es- 
timate the capacity of a hop i based on the relation between 
the Round- Trip Time (RTT) up to hop i and the probing 
packet size W . 



2. MODEL 

The well-known expression for throughput metric describing 
a ratio between a network delay and the packet size is a 
version of the Little's Law |13|. 



B = W/D 



(1) 



Here W is the size of transmitted packet and D is the net- 
working packet delay. This formula is ideally for calculation 
of available bandwidth between two network points that are 
connected immediately (in other words for distantion in one 
hop). In general case the delay value is caused by such 
constant network factors as propagation delay, transmission 
delay, per-packet router processing time, etc |18| . 

In 1999 Downey [6] for the first time has detected linear de- 
pendence of the minimum possible round trip time on the 
size of transferred packets. In 2004 precise experiments by 
Choi et al [2] proved that the minimum fixed delay compo- 
nent for a packet of size is a linear (or precisely, an affine) 
function of its size, 



(2) 



where d is each link of capacity of h hops and 5i is prop- 
agation delay. To validate this assumption, they check the 
minimum delay of packets of the same size for three path, 
and plot the minimum delay against the packet size. 

Let D{W) represents the point-to-point delay of a packet. 
Here we refer to it as the minimum path transit time for the 
given packet size W, denoted by D^'"'"'{W) = minD(VF). 
With the fixed delay component D^''^'"^{W) identified, we 
can now substract it from the point-to-point delay of each 
packet to study the variable delay component d*""^. The 
variable delay component of the packet, d""'^, is given by 



D{W) = Df''""'{W) + d 



(3) 



On the Fig. [T] the graphic shows the linear dependence be- 
tween average network delay Dav{W) = ¥,[D{W)] and packet 
size W like it is constructed in paper [2]. Slope angle con- 
cerning Y axe could be considered as available bandwidth 
Bav in contrast to bottleneck capacity C (maximum through- 



put) for computed minimal delay D-^'"'^''(W): 

Df"^\W) = D^,,, + W/C, (4) 

where 

(5) 



D™„ = lim D''^^\W) 



Prolongation of line D{W) from Fig. [T] to Y axe gives the 
intercept value a — X^^^j 5i. Then the Equation for the 
throughput metric which path consists of two or more hops 
should be modernized to the following view: 



Bav = W/{Dav - a) 



(6) 



The value a is related to the distance between the sites (i.e. 
propagation delay) and per-packet router processing time 
at each hop along the path between the sites ^ [4]. This 
value represents as the minimum delay Dmin for which the 
very small package can be transmitted on a network from 
one point in another. In the general case a(n, I) could be 
considered as the linear function depended on n and I, 



a = /(n, I) ~ an + (31 



(7) 



where n is the number of hops (routers) that is measured 
by the traceroute utility and I = l„ is the sum of single 
length of routing path. 

The Equation (|6| gives us the simple way for estimation 
of throughput metrics including active bandwidth Bav and 
capacity C. Our method supposes the variation of packet 
size on the same path for measurement of the throughput 
metrics. If the testing process between two fixed points is 
organized by packets with different sizes Wi and W2 then 
the delay times Di get two different values. Experiments 
should show the identical value for available bandwidth Bav 
independently from packet size Wi. The system from two 
equations with different values of variables Di = E[_D(W^i)] 
and Wi is easy solved to find Bav and a: 



Bav 



W2 ~ Wi 



(8) 



It should be noted that similar result was first time received 
for bandwidth- dominated path in classical paper of Jacob- 
son [9j dedicated congestion and avoidance control. 

Fig. |2] illustrates a schematic representation of transfer of 
packages of the different sizes on the slowest link in the path 
(the bottleneck). The vertical dimension is bandwidth, the 
horizontal dimension is time. 

Another result for capacity C will turn out, if instead of the 
average value Dav{W) in an analogue of the equation Q 

W 

^ " Df^^^^W)^D~ 
the minimum fixed delay component D^"'^'*(H/) is used 

W2 - Wi 



C = 



Dfi':<^'i{W2) - Df^^'^'^iWi) 



(10) 



It is necessary to notice that experimental definition of any 
throughput metrics demands carrying out of several mea- 
surements for a network delay. After these measurements 
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Figure 2: Available Bandwidth Illustration 



are spent for packages of the different sizes, it is necessary 
to choose from them the minimum and average values. The 
minimum value will be used for calculation of available band- 
width Bav, and average value for capacity C. Even in work 
of Downey [o] it was noticed that are many data points near 
the minimum and we can find the minimum delay Dmin with 
a small number of probes at each packet size. It should be 
noted that the method presented in given work allows mea- 
suring the available bandwidth and capacity of the outgoing 
channel. 



The minimal delay of datagram transmission D„ 
calculated as 



Brain — 



W2D1 - W1D2 

W2 - Wi 



may be 



(11) 



This value as well as the methods of its measurement has a 
important significance in applied tasks of control theory [l9] . 
The second significant question of networking control theory 
is the distribution type for variable delay component d"""" 
which should be studied. To know the expression for this 
parameter we may easy calculate the duration of buffer for 
streaming aplication on receiving side. 

3. PRECISE EXPERIMENTS 

A number of measurements in a global network have been 
spent for acknowledgement of our method. In this work the 
very first results which are already processed are presented 
only. 

For practical realization of our method the sizes Wi and W2 
should different in several times, it is reasonable to choose 
64 and 1064 bytes for Linux based systems, 32 and 1032 
bytes for Windows correspondingly. The basic problem of 
experimental testing is the precise of delay measurements 
that is necessary for accurate result. The exact metering 
demands micro second precision for delay measurements; 
we are reaching such accuracy with help of RIPE Test Box 
mechanism jT^. In order to prepare the experiments three 
Test Boxes have been installed in Moscow, Samara and Ros- 
tov on Don during 2006-2008 years in framework of RFBR 
grant 06-07-89074. Each RIPE Test Box represents a server 
under management of an FreeBSD operating system with 
the GPS receiver connected to it. 

Characteristic times of investigated processes (a packet de- 



lay, jitter) have the order from 10 ms to 1 sec, therefore is 
quite enough accuracy of system hours of a RIPE Test Box 
for their rehable measurement. At the first stage experiment 
between tt01.ripe.net (RIPE NCC at AMS-IX, Amsterdam) 
and ttl43.ripe.net (Samara, SSAU) have been made which 
included 



• Precision measurement of packet delay in the size 100 
and 1100 bytes with accuracy 2-12 /is 

• Measurement of available bandwidth by means of util- 
ity iperf [12] 

• Measurement of bandwidth by a method of download- 
ing of a file on FTP 

Thus, at us it will be generated alternatively measured three 
sizes of throughput metrics for the subsequent comparative 
analysis. 

It is necessary to notice that the utility iperf is started 
with an option -u and measures speed of a stream between 
two points that precisely enough corresponds to available 
bandwidth. Speed of downloading on ftp measures a Bulk- 
Transfer-Capacity (BTC) and gives strongly underestimated 
value. Unfortunately, at the given stage we could not spend 
more exact measurements, but further we assume to find 
partners for installation of exact utilities. 

The design of the RIPE TTM system meets all requirements 
shown by our method, namely it allows to change the size of 
a testing package and to find network delay with a split-hair 
accuracy. 

By default, testing is conducted by packages in the size of 
100 byte, but there is a page corresponding to point of the 
menu hConfigurationz of local Test Box. On which it is 
possible to add testing packages to RIPE Box up to 1500 
byte in size with demanded frequency. 

In our case it is reasonable to add testing 1100 (1024) byte 
packages with frequency of 60 times in a minute. It is nec- 
essary to notice that the results of tests will be available on 
next day. 

Testing results are available in telnet to RIPE Test Box on 
port 9142. It is important to come and write down simulta- 
neously the data on both ends of the investigated channel, in 
the case presented here it is tt01.ripe.net and ttl43.ripe.net. 
Obtained data will contain required delay of packages of the 
different sizes. Also, we need to distinguish packages. 

Therefore at first it is reversible to sending Box and we will 
find lines, see Table [l] 

Last value in string is sequence number of the packet. It 
is necessary to us to find this number on the receiving side 
at the channel. The string example on the receiving side is 
lower resulted, see Table 1] 

For set number of a package it is easy to find network delay, 
in our case it makes 0.044084 seconds. The following package 
1039148557 has the size of 100 bytes and its delay makes 



0.043591 seconds. Thus, the difference will make 0.000493 
second. 

Our model assumes operations with minimal and average 
values; therefore we should note average values, not less than 
five pairs for the delay, going consistently. In our case, av- 
erage difference E[Z)(1024) - E[Z)(100) is 0.000571 seconds. 
(ttl43 -> ttOl). Then the required bandwidth of the fink 
(ttl43 -> ttOl) can be calculated as 



B„„(ttl43 ^ tm) = = 12.9[M6ps] (12) 



The minimal and average values of the return link (ttOl 
-> ttl43) are E[_D(1024)] - E[L»(100)] = 0.000511 second 
and _D^^^'''(1024) - D-''"'^'*(100) = 0.000492 second/ Then 
available bandwidth and capacity can be calculated as 

C(tm ttl43) = ^^^r^ = 15.0[AfM (13) 



0.000492 

B„„(tt01 ^ ttl43) = = 14.7[A/fepsl 



(14) 



The main problem of the offered method consists in under- 
standing, what value is measured. Actually, it can be bulk 
transport capacity or available bandwidth. Alternative mea- 
surements of the given values are necessary for specification. 

It is ideal to compare the width received by our method to 
the values measured by alternative methods, first of all by 
means of the utility iperf. Unfortunately, such tests are not 
spent yet, we allocate only in the speed of FTP downloading. 
It makes 3.04 - 3.20 Mbps in a direction from ttl43.ripe.net 
to tt01.ripe.net and 3.2-3.3 Mbps in the opposite direction. 
That is additional researches for which carrying out partners 
are required are necessary. 

It should be noted that Table II from paper [2] gives us 
these values; calculated slope is inverse value to end-to-end 
capacity. The corresponding capacities for data set 1, 2, 3 
(path 1 and 2) are 285 Mbps, 128 Mbps, 222 Mbps and 205 
Mbps. 

4. AVBAND UTILITY 

Routinely the special utilities could be used for delay mea- 
surements; we tried to test traditional ping, the new UDP- 
ping and other utility. In result of test the simplest utility 
ping was found to be a best choice for delay measurements. 

Utility AvBand (Available Bandwidth) has been developed, 
realizing the above described method, using in the basis al- 
gorithm ping. This algorithm has been developed by Mike 
Muus in 1983 in the USA for operating system BSD [T4| . 
Its advantage consists that it is possible to work with any 
router or the host which responds to packages of inquiries 
ICMP Echo. The given version of the utility is developed for 
platform Windows and uses library ICMP Windows API. In 
the near future we plan working out of the utility for Unix 
systems, first of all for family Linux. 

The given utility defines available bandwidth of outgoing 
channel between host from which measurement and a remote 



SNDP 9 1240234684 -h tt01.ripe.net -p 6000 -n 1024 -s 1039148464 
SNDP 9 1240234685 -h ttl64.ripe.net -p 6000 -n 100 -s 1039148548 
SNDP 9 1240234685 -h tt01.ripe.net -p 6000 -n 100 -s 1039148557 

Table 1: The data of sending box 

RCDP 12 2 89.186.245.200 60322 193.0.0.228 6000 1240234684.785799 0.044084 0X2107 0X2107 1039148464 0.000002 0.000008 
RCDP 12 2 89.186.245.200 53571 193.0.0.228 6000 1240234685.788367 0.043591 0X2107 0X2107 1039148557 0.000002 0.000008 

Table 2: The data of receivig box 
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Figure 3: The AvBand Screenshot 



server interesting us is spent. For this purpose the program 
measures RTT (Round Trip Time) that is the time between 
sending of inquiry and answer reception. Thus at first pack- 
ages in 32 bytes (standard Windows size) are generated and 
their RTT is defined, and the following step forms packages 
of the size in 1032 bytes and is measured their RTT. On 
Fig. [3] the screenshot of the program is presented. 

In the field "Host" it is entered a host name, available band- 
width to which we are going to measure. In the field "Re- 
tries" the quantity of the echo-inquiries which will be sent 
on a remote host is underlined. After that enough to press 
button"Start" and the utility will send the set quantity of 
packages of the size of 32 bytes, further the same quantity of 
packages in the size of 1032 bytes. The collected values of the 
received delays on each of groups of packages are averaged, 
and then by means of our model the available bandwidth 
of the channel pays off and is displayed. It is necessary to 
notice that the available bandwidth of the outgoing channel 
is measured. 

For check of utility AvBand a series of experiences with use 
of following measuring mechanisms also has been spent: 

• Utility AvBand 

• Standard pmg 

• Iperf 

• FTP 

Measurements with Samara State Aerospace University (SSAU), 
Institute of Organic Chemistry of the Russian Academy of 



Sciences (IOC RAS), control centre RIPE in Amsterdam 
(RIPE), Ohio State University (OSU), and also a number 
of local experiments with use of networks of various Inter- 
net Service Providers of the Samara region (Infolada, AIST, 
VolgaTelecom, etc.) have been currently spent. All data on 
experiments is resulted in the table more low. 

As a case in point ADSL connection in Samara region could 
be chosen for illustration of our approach. The delay mea- 
surements give Di = 18 ms, D2 ~ 42 ms, that corresponds 
to 350 Kbps of available bandwidth. During FTP session 
the delay grows to 300 ms and 4^5 ms that corresponds 
approximately to 60 Kbps of available bandwidth. This is 
very rough computation, but it could be made quickly and 
independently. 

5. CONCLUSION 

Now measurements are not completed yet, is planned to 
type the data from not less than 50 points scattered on ter- 
ritory of a planet. From these measurements not less than 
10 should be fulfilled with application of RIPE Test Boxes. 
Thus, summing up to the done operation, it is possible to 
draw the main output: the theoretical model of calculation 
of an available bandwidth proves to be true. 

Further it is planned to continue researches to establish 
type of distribution for a network delay. At definition of 
type of distribution it is supposed to use analogy to molec- 
ular physics, namely about distribution of molecules in the 
speeds Maxswell. Probably, in our case required distribu- 
tion should be presented in the form of product of normally 
(Gaussian) distribution and the inverse function defined by 
the Equation |6] The knowledge of density of distribution in 
TCP/IP networks will help to find a new class the decision 
in the networked control systems. 

In summary we would like to express special gratitude of 
Prasad Calyam and Gregg Trueb from Ohio State Univer- 
sity for the invaluable help at carrying out of measurements. 
Also it would be desirable to thank all collective of technical 
service RIPE ncc and especially Ruben van Staveren and 
Roman Kalyakin for constant assistance in comprehension 
of subtleties of a measuring infrastructure. 
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